Imaging device, imaging method, and program

ABSTRACT

The present technology relates to an imaging device, an imaging method, and a program that make it possible to easily perform imaging focusing on a subject or a specific part of the subject. 
     The imaging device causes a preliminary-notice frame that gives notice of a specific area to be focused to be displayed on an image obtained by an imaging unit according to a type of the subject. The present technology can be applied to an imaging device.

CROSS REFERENCES TO RELATED APPLICATIONS

The present application is a Continuation Application of U.S. patentapplication Ser. No. 17/416,890 filed Jun. 21, 2021, which is a 371National Stage Entry of International Application No.:PCT/JP2019/048877, filed on Dec. 13, 2019, which in turn claims priorityfrom Japanese Application No. 2018-246877, filed on Dec. 28, 2018, theentire contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present technology relates to an imaging device, an imaging method,and a program, and more particularly to an imaging device, an imagingmethod, and a program that make it possible to easily perform imagingfocusing on a subject or a specific part of the subject.

BACKGROUND ART

Patent Document 1 proposes an imaging device that detects a pupil area,which is an area of a pupil of a person, and focuses on the detectedpupil area.

CITATION LIST Patent Document Patent Document 1: InternationalPublication No. 2015/045911 SUMMARY OF THE INVENTION Problems to beSolved by the Invention

The imaging device disclosed in Patent Document 1 detects only a pupilarea of a person, and it has been difficult to detect a pupil area of ananimal.

The present technology has been conceived in view of such a situation,and it aims to easily perform imaging focusing on a subject or aspecific part of the subject.

Solutions to Problems

An imaging device according to one aspect of the present technologyincludes a display control unit that causes a preliminary-notice framethat gives notice of a specific area to be focused to be displayed on animage obtained by an imaging unit according to a type of a subject.

According to one aspect of the present technology, a preliminary-noticeframe that gives notice of a specific area to be focused is displayed onan image obtained by an imaging unit according to a type of a subject.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an exemplary process of detecting apupil of a person.

FIG. 2 is a diagram illustrating an exemplary process of detecting apupil of an animal.

FIG. 3 is a diagram illustrating a method of instructing a start offocusing in the case of an animal pupil detection mode.

FIG. 4 is a diagram illustrating a method of instructing a start offocusing in the case of the animal pupil detection mode.

FIG. 5 is a block diagram illustrating an exemplary main configurationof an imaging device to which the present technology is applied.

FIG. 6 is a block diagram illustrating an exemplary configuration of adigital signal processing unit.

FIG. 7 is a diagram illustrating a selection method in a case where aplurality of pupils is detected in a human pupil detection mode.

FIG. 8 is a diagram illustrating a selection method in a case where aplurality of pupils is detected in the animal pupil detection mode.

FIG. 9 is a diagram illustrating a relationship between the orientationof a face of a subject and the number of detected pupil areas.

FIG. 10 is a flowchart illustrating an imaging process in the humanpupil detection mode.

FIG. 11 is a flowchart illustrating the imaging process in the humanpupil detection mode continuing from FIG. 10 .

FIG. 12 is a flowchart illustrating an imaging process in the animalpupil detection mode.

FIG. 13 is a flowchart illustrating the imaging process in the animalpupil detection mode continuing from FIG. 12 .

FIG. 14 is a flowchart illustrating a pupil area selection process instep S114 of FIG. 12 .

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, an embodiment for implementing the present technology willbe described. Descriptions will be given in the following order.

1. Present technology overview

2. Exemplary configuration of imaging device

3. Selection method in a case where multiple pupils are detected

4. Exemplary operation of imaging device

<1. Present Technology Overview>

An imaging device according to an embodiment of the present technologyhas a detection mode for each specific part, which detects an area of aspecific part of a subject and uses the detected area of the specificpart for focusing. Examples of the detection mode for each specific partinclude a human pupil detection mode and an animal pupil detection mode.

FIG. 1 is a diagram illustrating an exemplary process of detecting apupil of a person.

FIG. 1 illustrates a screen displayed on a display unit of the imagingdevice in a case where the human pupil detection mode is set. The screenon the left side in FIG. 1 is a screen displayed before an operation forinstructing a start of focusing is performed by a user. The screen onthe right side is a screen displayed after the operation for instructinga start of focusing is performed by the user. Note that a face of aperson is displayed on the screen.

In a case where the human pupil detection mode is set, as illustrated onthe left side in FIG. 1 , a face area that overlaps a focus frame F isdetected among the face areas that are areas of faces, and a facepreliminary-notice frame PF that gives notice of the detected face areais displayed. In the example on the left side in FIG. 1 , the facepreliminary-notice frame PF is displayed to partially overlap the focusframe F. The focus frame F is a focus setting frame for setting a focus.

In a case where the user performs the operation for instructing a startof focusing in this state, as illustrated on the right side in FIG. 1 ,detection of a pupil area, which is an area of a pupil, is performed onthe face area, and a pupil frame AE indicating the detected pupil areais displayed in place of the face preliminary-notice frame PF.Furthermore, focusing is performed on the pupil area surrounded by thepupil frame AE.

FIG. 2 is a diagram illustrating an exemplary process of detecting apupil of an animal.

FIG. 2 illustrates a screen displayed on the display unit of the imagingdevice in a case where the animal pupil detection mode is set. Thescreen on the left side in FIG. 2 is a screen displayed before theoperation for instructing a start of focusing is performed by the user.The screen on the right side is a screen displayed after the operationfor instructing a start of focusing is performed by the user. Note thata face of an animal (cat) is displayed on the screen.

In a case where the animal pupil detection mode is set, as illustratedon the left side in FIG. 2 , detection of the pupil area is performed onthe inside and outside of the focus frame F, and a pupilpreliminary-notice frame PE that gives notice of the detected pupil areais displayed. Note that, at this time, the detection of the pupil areais performed with priority given to the inside of the focus frame F.

In a case where the operation for instructing a start of focusing isperformed by the user in this state, as illustrated on the right side inFIG. 2 , the pupil frame AE indicating the pupil area is displayed inthe pupil area in place of the pupil preliminary-notice frame PE.Furthermore, focusing is performed on the pupil area surrounded by thepupil frame AE.

For example, the pupil frame AE is displayed according to a displaymethod different from the pupil preliminary-notice frame PE such as thepupil preliminary-notice frame PE is displayed as a white frame and thepupil frame AE is displayed as a green frame. Note that the facepreliminary-notice frame PF and the pupil frame AE are displayed in asimilar manner.

As described above, in a case where the human pupil detection mode isset, a face area is detected and the face preliminary-notice frame PF isdisplayed in the detected face area before the operation for instructinga start of focusing is performed by the user.

Meanwhile, in a case where the animal pupil detection mode is set, apupil area is detected and the pupil preliminary-notice frame PE isdisplayed in the detected pupil area before the operation forinstructing a start of focusing is performed by the user.

With the preliminary-notice frame displayed before the user performs theoperation for instructing a start of focusing, it is known in advancethat the intended position or an unintended position has been detected,whereby the user is enabled to select not performing automatic focusing.This makes it possible to easily perform imaging focusing on a specificpart of the subject.

FIGS. 3 and 4 are diagrams illustrating a method of instructing a startof focusing in a case where the animal pupil detection mode is set.

With the imaging device, the user can make an instruction for a focusingstart by pressing a pupil autofocus (AF) button P, pressing an AF-ONbutton Q, pressing a shutter button R halfway, or the like.

As illustrated on the left side in FIG. 3 , the pupil AF button P isconfigured as, for example, a center button located at the center of across button provided on the back surface of the imaging device. Thepupil AF button P is a dedicated button for instructing a start offocusing on the pupil, which is a specific part of the subject.

As described above, the pupil preliminary-notice frame is displayed inthe detected pupil area in the image of the subject on the display unitof the imaging device before the operation for instructing a start offocusing is performed by the user.

In a case where the user presses the pupil AF button P in this state,the display unit displays a screen as illustrated on the right side inFIG. 3 .

As illustrated on the right side in FIG. 3 , the focus frame F and thepupil frame AE are displayed on the screen in a manner of overlappingthe image in which a cat is facing the front. On the right side in FIG.3 , the focus frame F is displayed at the center of the screen, which isaround the back of the cat.

In a case where the user presses the pupil AF button P, a range up toapproximately 50% of the screen is set as a detection range W1 of thepupil area with reference to the center of the focus frame F. Note thatthe detection range W1 is not displayed in actuality. Note that thefocus frame F itself may be set in a wide range like the detection rangeW1.

When the pupil area is detected in the detection range W1 in a casewhere the user presses the pupil AF button P, the pupil frame AE isdisplayed in the pupil area in place of the pupil preliminary-noticeframe having been displayed before the pressing of the pupil AF buttonP.

Furthermore, as illustrated on the left side in FIG. 4 , the AF-ONbutton Q is provided on the upper side of the back surface of theimaging device, for example. The AF-ON button Q is a button forinstructing a start of focusing on the pupil in the focus frame F.

As illustrated on the left side in FIG. 4 , the shutter button R isprovided on the upper surface of the imaging device, for example. In asimilar manner to the AF-ON button Q, the shutter button R is a buttonfor instructing a start of focusing on the pupil in the focus frame F inthe case of being pressed halfway by the user, and is a button forinstructing a shutter in the case of being pressed fully by the user.

As described above, the pupil preliminary-notice frame is displayed inthe detected pupil area in the image of the subject on the display unitof the imaging device before the operation for instructing a start offocusing is performed by the user.

In a case where the user presses the AF-ON button Q in this state, or ina case where the user presses the shutter button R halfway, a screen asillustrated on the right side in FIG. 4 is displayed on the displayunit.

As illustrated on the right side in FIG. 4 , the focus frame F and thepupil frame AE are displayed on the screen in a manner of overlappingthe image in which a dog is sleeping next to the cat. On the right sidein FIG. 4 , the focus frame F is displayed on the left pupil of the cat.

In a case where the user presses the AF-ON button Q, a range from thecenter of the focus frame F to the vicinity of the focus frame F is setas a detection range W2 of the pupil area. Note that the detection rangeW2 is not displayed in actuality.

When the pupil area is detected in the detection range W2 in a casewhere the user presses the AF-ON button Q, the pupil frame AE isdisplayed in the pupil area in place of the pupil preliminary-noticeframe having been displayed before the pressing of the AF-ON button Q.

As described above, in the case of the animal pupil detection mode, thepupil preliminary-notice frame that gives notice of the pupil area isdisplayed in the imaging device before the operation for instructing astart of focusing is performed by the user. When the user performs theoperation for instructing a start of focusing, the pupil frame AEindicating the pupil area is displayed, and the focusing is performed onthe pupil area.

Therefore, it becomes possible to promptly grasp the position of theanimal pupil in the image. As a result, the user can easily performimaging focusing on the pupil of the animal.

Note that the position at which each button is provided on the imagingdevice is not limited to the position illustrated in FIGS. 3 and 4 , andmay be another position.

Furthermore, although an exemplary case of detecting a pupil as aspecific part of the subject has been described above, the subjectitself may be detected in a case where the subject is a small animalsuch as a bird.

<2. Exemplary Configuration of Imaging Device>

FIG. 5 is a block diagram illustrating an exemplary main configurationof the imaging device.

An imaging device 100 illustrated in FIG. 5 has a detection mode foreach specific part of the subject, which includes the human pupildetection mode and the animal pupil detection mode. Note that adetection mode according to a specific part can be provided in theimaging device 100, not limited to a pupil of a person or a pupil of ananimal. The user can select and set a desired mode from each detectionmode for the subject or a specific part of the subject.

As illustrated in FIG. 5 , the imaging device 100 includes a lens 101, adiaphragm 102, an imaging element 103, an analog signal processing unit104, an analog/digital (A/D) converter 105, and a digital signalprocessing unit 106. The imaging device 100 includes a lens driver 121,a timing generator (TG) 122, a gyroscope 123, and a system controller131.

Furthermore, the imaging device 100 includes a display unit 141, astorage 142, an input unit 143, an output unit 144, a communication unit145, an operation unit 146, and a drive 147.

The lens 101 adjusts a focus to the subject, and collects the light fromthe focused position. The diaphragm 102 adjusts exposure.

The imaging element 103 images the subject to obtain a captured image.That is, the imaging element 103 photoelectrically converts the lightfrom the subject to output it to, as image signals, the analog signalprocessing unit 104. On the basis of such photoelectric conversion, theimaging element 103 may capture a still image, or may capture a movingimage.

The analog signal processing unit 104 performs analog signal processingon the image signals obtained by the imaging element 103. The A/Dconverter 105 performs A/D conversion on the image signals having beensubject to the analog signal processing to obtain image data that aredigital signals.

The digital signal processing unit 106 performs digital signalprocessing on the image data obtained by the A/D converter 105. As thedigital signal processing, the digital signal processing unit 106 atleast detects an area of the subject or a specific part of the subjectfrom the moving image supplied as the image data, and performsprocessing such as setting a focus area. Hereinafter, a specific part ofthe subject will be simply referred to as a specific part.

Furthermore, the digital signal processing unit 106 also performsprocessing for controlling display of a frame or the like indicating thearea of the subject or the specific part on the basis of the detectionresult of the area of the subject or the specific part. Details of thoseprocesses will be described later.

Note that the contents of the digital signal processing are optional,and processing other than the above may be performed. For example, thedigital signal processing unit 106 may perform, as the digital signalprocessing, color mixture correction, black level correction, whitebalance adjustment, demosaic processing, matrix processing, gammacorrection, YC conversion, and the like. Furthermore, the digital signalprocessing unit 106 may perform codec processing, which is processingassociated with encoding and decoding of image data, as the digitalsignal processing.

The lens driver 121 drives the lens 101 and the diaphragm 102, andcontrols a focal length, exposure, and the like. The TG 122 generatesand supplies synchronization signals to the imaging element 103 to drivethe imaging element 103, and controls imaging. The gyroscope 123 is asensor that detects a position and an attitude of the imaging device100. The gyroscope 123 outputs detected sensor information to the A/Dconverter 105.

The system controller 131 includes, for example, a central processingunit (CPU), a read only memory (ROM), a random access memory (RAM), andthe like, and controls each processing unit of the imaging device 100 byexecuting a program or processing data. Furthermore, on the basis ofsignals supplied from the operation unit 146, the system controller 131receives operation input made by the user, and performs processing orcontrol corresponding to the operation input.

For example, the system controller 131 can control the focal length,exposure, and the like on the basis of, for example, the detectionresult of the area of the subject or the specific part supplied from thedigital signal processing unit 106.

The display unit 141 is configured as, for example, a liquid crystaldisplay or the like, and displays an image corresponding to the imagedata stored in the memory of the digital signal processing unit 106. Forexample, the display unit 141 can display a taken image obtained by theimaging element 103, a saved captured image, and the like.

The storage 142 stores image data stored in the memory of the digitalsignal processing unit 106. At that time, the storage 142 stores codeddata coded by the digital signal processing unit 106 to reduce the datavolume. The coded data stored in the storage 142 is read out and decodedby the digital signal processing unit 106, and is displayed on thedisplay unit 141, for example.

The input unit 143 includes an external input interface such as anexternal input terminal, and outputs, to the digital signal processingunit 106, various kinds of data (e.g., image data and coded data)supplied from the outside of the imaging device 100 via the externalinput interface.

The output unit 144 includes an external output interface such as anexternal output terminal, and outputs various kinds of data supplied viathe digital signal processing unit 106 to the outside of the imagingdevice 100 via the external output interface.

The communication unit 145 performs, with another device, predeterminedcommunication that is at least one of wired communication or wirelesscommunication, and exchanges data with the another device through thepredetermined communication. For example, the communication unit 145outputs various kinds of data (e.g., image data and coded data) suppliedfrom the digital signal processing unit 106 to the another devicethrough the predetermined communication. Furthermore, the communicationunit 145 obtains various kinds of data from the another device throughthe predetermined communication, and outputs the obtained data to thedigital signal processing unit 106.

The operation unit 146 includes an optional input device such as a key,a button, or a touch panel, for example. The operation unit 146 includesthe pupil AF button P, the AF-ON button Q, or the shutter button Rdescribed above with reference to FIG. 3 or 4 . The operation unit 146receives operation input made by the user, and outputs signalscorresponding to the operation input to the system controller 131.

The drive 147 reads out information (programs, data, etc.) stored in aremovable recording medium 148 such as a semiconductor memory, which isattached to the drive itself, for example. The drive 147 supplies theinformation read from the removable recording medium 148 to the systemcontroller 131. Furthermore, in a case where a writable removablerecording medium 148 is attached to the drive 147, the drive 147 cancause the removable recording medium 148 to store the information (imagedata, coded data, etc.) supplied via the system controller 131.

Note that the lens 101, the diaphragm 102, and the lens driver 121described above may be formed as an interchangeable lens 151 that isdetachable (replaceable) from the imaging device 100 and has a housingseparate from the imaging device 100.

FIG. 6 is a block diagram illustrating an exemplary configuration of thedigital signal processing unit 106.

The digital signal processing unit 106 includes a memory 211, a subjectdetection unit 212, an area setting unit 213, a display control unit214, and a codec processing unit 215.

The memory 211 stores image data supplied from the A/D converter 105.The image data is, for example, image data of each frame of a movingimage or image data of a still image.

The subject detection unit 212 detects an area of a subject or aspecific part from image data stored in the memory 211 on the basis ofthe signals corresponding to the operation input made by the user, whichare supplied from the system controller 131. The subject detection unit212 outputs a detection result of the area of the subject or thespecific part to the area setting unit 213 and the display control unit214.

The subject detection unit 212 includes a person detection unit 212-1,an animal detection unit 212-2, and an animal detection unit 212-3.

In a case where a detection mode for each specific part of the subjectis the human pupil detection mode, the person detection unit 212-1detects a face area of a person, and outputs a detection result of thedetected face area to the area setting unit 213 and the display controlunit 214. In a case where an operation for instructing a start offocusing is performed by the user, the person detection unit 212-1detects a pupil area of the person on the basis of the detection resultof the face area, and outputs a detection result of the pupil area tothe area setting unit 213 and the display control unit 214.

The animal detection units 212-2 and 212-3 differ in the type of animalto be detected. In a case where a detection mode for each specific partof the subject is the animal pupil detection mode, the animal detectionunits 212-2 and 212-3 detect a pupil area of a target animal, and outputa detection result of the detected pupil area of the animal to the areasetting unit 213 and the display control unit 214.

Techniques such as deep learning are used to detect a pupil of ananimal, for example. In a case where an operation for instructing astart of focusing is performed by the user, the animal detection units212-2 and 212-3 detect a pupil of an animal according to a focus frame,and outputs a detection result of the detected pupil area of the animalto the area setting unit 213 and the display control unit 214.

For example, the animal detection unit 212-2 detects a pupil area of ananimal such as a dog or a cat. The animal detection unit 212-3 detects apupil area of an animal such as a lizard or a frog. Another animaldetection unit may be provided depending on a type of the animal havingthe same characteristics at the time of detection, for example, notlimited to only the animal detection units 212-2 and 212-3.

Depending on the detection mode for each specific part of the subject,the area setting unit 213 sets, as a focus area, either the area of thespecific part of the subject detected by the subject detection unit 212or the area indicated by the focus frame. The area setting unit 213supplies information associated with the set focus area to the systemcontroller 131.

According to the signals corresponding to the operation input made bythe user, which are supplied from the system controller 131, the displaycontrol unit 214 generates a focus frame to cause the display unit 141to superimpose and display it on the image from the memory 211. Theinformation associated with the focus frame is output to the subjectdetection unit 212.

Furthermore, the display control unit 214 generates a predeterminedframe (face frame, preliminary-notice frame, or pupil frame) accordingto the face or pupil area detected by the subject detection unit 212 onthe basis of the signals corresponding to the operation input made bythe user, which are supplied from the system controller 131. The displaycontrol unit 214 superimposes the generated predetermined frame on theimage from the memory 211, and causes the display unit 141 to displayit. Information associated with the face frame, the preliminary-noticeframe, or the pupil frame is output to the subject detection unit 212 asnecessary.

Note that the display control unit 214 generates an image of a graphicaluser interface (GUI) such as a menu, a button, or a cursor, and displaysit together with a taken image, a captured image, or the like.

The codec processing unit 215 performs processing related to encodingand decoding of image data of moving images or still images stored inthe memory 211.

<3. Selection Method in a Case where Multiple Pupils are Detected>

FIG. 7 is a diagram illustrating a selection method in a case where aplurality of pupils is detected in the human pupil detection mode.

A screen displayed before the user performs an operation for instructinga start of focusing is illustrated in A of FIG. 7 . A screen displayedafter the user performs the operation for instructing a start offocusing is illustrated in B of FIG. 7 .

In a case where the human pupil detection mode is set, as illustrated inA of FIG. 7 , a face area that overlaps the focus frame F is detectedamong the face areas, and a face preliminary-notice frame PF indicatingthe detected face area is displayed.

In a case where the user performs the operation for instructing a startof focusing in this state, as illustrated in B of FIG. 7 , detection ofa pupil area is performed on the face area, and a pupil frame AEindicating the detected pupil area is displayed. Furthermore, focusingis performed on the pupil area surrounded by the pupil frame AE.

At this time, in the detected face area, the pupil area located on thenear side of the imaging device 100 is detected. Therefore, in a casewhere the left pupil is located on the near side of the imaging device100, the pupil frame AE is displayed on the left pupil even if the usersets the focus frame F on the right pupil, as illustrated on the leftside in B of FIG. 7 . Furthermore, in a case where the right pupil islocated on the near side of the imaging device 100, the pupil frame AEis displayed on the right pupil even if the user sets or does not setthe focus frame F on the right pupil, as illustrated on the right sidein B of FIG. 7 .

In this manner, in the human pupil detection mode, the user simplyselects a face to focus on the front pupil in the selected face area,regardless of the position of the focus frame F.

FIG. 8 is a diagram illustrating a selection method in a case where aplurality of pupils is detected in the animal pupil detection mode.

A screen displayed before the user performs an operation for instructinga start of focusing is illustrated in A of FIG. 8 . A screen displayedafter the user performs the operation for instructing a start offocusing is illustrated in B of FIG. 8 .

In a case where the animal pupil detection mode is set, as illustratedin A of FIG. 8 , detection of a pupil area is performed on the insideand outside of the focus frame F, and the pupil preliminary-notice framePE that gives notice of the detected pupil area is displayed. Note that,at this time, the detection of the pupil area is performed with prioritygiven to the inside of the focus frame F.

However, in a case where a plurality of pupil areas is detected, thepupil preliminary-notice frame PE is displayed in the pupil area locatedon the near side of the imaging device 100 and closer to the center(center position) of the focus frame F. Note that details of theselection of the pupil area will be described later with reference toFIG. 9 .

In a case where the user performs the operation for instructing a startof focusing, as illustrated in B of FIG. 8 , the pupil frame AE isdisplayed in the selected pupil area, and focusing is performed on thepupil area indicated by the pupil frame AE.

Note that it is also possible to set the pupil preliminary-notice framePE not to be displayed. In this case, it becomes possible to suppresshiding of a facial expression of the subject caused by the display ofthe pupil preliminary-notice frame PE.

FIG. 9 is a diagram illustrating a relationship between the orientationof a face of a subject and the number of pupil areas.

FIG. 9 illustrates images P1 to P7 with a fox as a subject. The foxesappearing in the images P1 to P7 have different face orientations(angles). A rectangle of a solid line indicates a front pupil areadetected in each image, and a rectangle of a broken line indicates aback pupil area detected in each image.

The image P1 shows a fox facing to the left. The image P2 shows a foxfacing to the diagonally forward left. The image P3 shows a fox facingto the slightly diagonally forward left. The image P4 shows a fox facingforward. The image P5 shows a fox facing to the slightly diagonallyforward right. The image P6 shows a fox facing to the diagonally forwardright. The image P7 shows a fox facing to the right.

Of those images, each of the images P1, P2, P6, and P7, which shows afox facing diagonally forward or sideways (right and left), indicates acase where only a pupil area located on the near side of the imagingdevice 100 is detected.

In each of the images P3 and P5, which shows a fox facing slightlydiagonally forward, two pupil areas are detected, and it is easy todetermine which one of the pupil areas is located on the near side ofthe imaging device 100 and the other pupil area is located on the farside.

In the image P4, which shows a fox facing forward, it is difficult todetermine which of the left pupil area and the right pupil area islocated on the near side. In this case, as described above, apreliminary-notice frame or a pupil frame is displayed in the pupil arealocated on the near side of the imaging device 100 and closer to thecenter of the focus frame.

<4. Exemplary Operation of Imaging Device>

FIG. 10 is a flowchart illustrating an imaging process of the imagingdevice 100 in the human pupil detection mode.

The imaging process in the human pupil detection mode of FIG. 10 startswhen the power is turned on by a power button being operated, forexample. A detection mode for each specific part of the subject is setin advance as a human pupil detection mode from a setting screen or thelike.

In step S11 of FIG. 10 , the system controller 131 determines whether ornot to terminate the process, for example, whether or not the powerbutton has been operated.

In a case where the process is determined to be terminated in step S11,the imaging process is terminated.

In a case where the process is determined not to be terminated in stepS11, the process proceeds to step S12.

In step S12, the imaging element 103 photoelectrically converts thelight from the subject collected through the lens 101 and the diaphragm102 in pixel units to obtain an electric signal of each pixel of theimage. An image signal, which is an electric signal of each pixel of theimage, is output to the memory 211 of the digital signal processing unit106 via the analog signal processing unit 104 and the A/D converter 105.

In step S13, the display control unit 214 causes the display unit 141 todisplay an image based on the image data stored in the memory 211 as alive view image.

In step S14, the person detection unit 212-1 detects a face area fromthe image data stored in the memory 211. The person detection unit 212-1supplies information associated with the detected face area to the areasetting unit 213 and the display control unit 214.

The user provides an instruction for starting focusing by performing anoperation such as pressing the pupil AF button, pressing the AF-ONbutton, or pressing the shutter button halfway. Note that theinstruction for starting focusing is provided for each image capturingunit. The operation unit 146 receives operation input made by the user,and outputs signals corresponding to the operation input to the systemcontroller 131.

In step S15, the system controller 131 determines whether or not theuser has pressed the pupil AF button. In a case where the pupil AFbutton is determined to have been pressed in step S15, the processproceeds to step S16.

In step S16, the system controller 131 forcibly changes the focus frameto a wide range.

In step S17, the person detection unit 212-1 detects a pupil area withrespect to the face area in the focus frame under the control of thesystem controller 131. Information associated with the detected pupilarea is output to the area setting unit 213 and the display control unit214.

In step S18, the area setting unit 213 determines whether or not thepupil area has been detected. In a case where the pupil area isdetermined to have been detected in step S18, the process proceeds tostep S19.

In step S19, the area setting unit 213 sets the pupil area detected bythe person detection unit 212-1 as a focus area. Information associatedwith the set focus area is supplied to the system controller 131.

In a case where the pupil area is determined not to have been detectedin step S18, the process proceeds to step S20.

In step S20, the area setting unit 213 sets the face area detected bythe person detection unit 212-1 as a focus area. Information associatedwith the set focus area is output to the system controller 131.

Meanwhile, in a case where the pupil AF button is determined not to havebeen pressed in step S15, the process proceeds to step S21.

In step S21, the system controller 131 determines whether or not theuser has pressed the shutter button halfway or whether or not the userhas pressed the AF-ON button.

In a case where it is determined in step S21 that the shutter button hasbeen pressed halfway or the AF-ON button has been pressed, the processproceeds to step S22.

In step S22, the system controller 131 does not change the focus frame.

In step S23, the person detection unit 212-1 detects a pupil area withrespect to the face area in the focus frame under the control of thesystem controller 131. Information associated with the detected pupilarea is output to the area setting unit 213 and the display control unit214.

In step S24, the area setting unit 213 determines whether or not thepupil area has been detected. In a case where the pupil area isdetermined to have been detected in step S24, the process proceeds tostep S25.

In step S25, the area setting unit 213 sets the pupil area detected bythe person detection unit 212-1 as a focus area. Information associatedwith the set focus area is supplied to the system controller 131.

In a case where the pupil area is determined not to have been detectedin step S24, the process proceeds to step S26.

In step S26, the area setting unit 213 sets the focus frame or the facearea detected by the person detection unit 212-1 as a focus area.Information associated with the set focus area is output to the systemcontroller 131.

Furthermore, in a case where it is determined in step S20 that theshutter button has not been pressed halfway or the AF-ON button has notbeen pressed, the process proceeds to step S27.

In step S27, the area setting unit 213 sets the face area detected bythe person detection unit 212-1 as a focus area. Information associatedwith the set focus area is output to the system controller 131.

In step S28, the display control unit 214 generates a facepreliminary-notice frame in the face area detected by the persondetection unit 212-1, superimposes the face preliminary-notice frame onthe live view image, and causes the display unit 141 to display it.

Subsequent to steps S19, S20, and S25, the process proceeds to step S29of FIG. 11 .

In step S29, the system controller 131 controls the lens driver 121 todrive an optical system such as the lens 101 and the diaphragm 102 insuch a manner that the focus area is in focus. Thereafter, the processproceeds to step S30.

The process also proceeds to step S30 subsequent to step S27 of FIG. 11.

In step S30, the system controller 131 determines whether or not thefocusing has been complete.

In a case where the focusing is determined to have been complete in stepS30, the process proceeds to step S31.

In step S31, the display control unit 214 causes the display unit 141 todisplay an image based on the image data stored in the memory 211 as alive view image. Furthermore, the display control unit 214 superimposesan in-focus frame (pupil frame, face frame, or focus frame), which is aframe surrounding the set focus area, on the live view image, and causesthe display unit 141 to display it.

In a case where the focusing is determined not to have been complete instep S30, the process skips step S31 and proceeds to step S32.

Furthermore, the process proceeds to step S32 subsequent to step S29 ofFIG. 10 .

In step S32, the system controller 131 determines whether or not theshutter button has been fully pressed on the basis of the signalscorresponding to the operation input from the operation unit 146. In acase where the shutter button is determined to have been fully pressedin step S32, the process proceeds to step S33.

In step S33, the imaging element 103 photoelectrically converts thelight from the subject collected through the optical system such as thelens 101 and the diaphragm 102 in pixel units to obtain an electricsignal of each pixel of the image. An image signal, which is an electricsignal of each pixel of the image, is output to the memory 211 of thedigital signal processing unit 106 via the analog signal processing unit104 and the A/D converter 105.

In step S34, the display control unit 214 causes the display unit 141 todisplay an image based on the image data stored in the memory 211 as acaptured image.

In step S35, the codec processing unit 215 encodes the image data storedin the memory 211. The codec processing unit 215 supplies the encodedimage data to the storage 142.

In step S36, the codec processing unit 215 causes the storage 142 torecord the encoded image data. Thereafter, the process returns to stepS11, and the subsequent processing is repeated.

Furthermore, also in a case where the shutter button is determined notto have been fully pressed in step S32, the process returns to step S11,and the subsequent processing is repeated.

FIG. 12 is a flowchart illustrating an imaging process of the imagingdevice 100 in the animal pupil detection mode.

The imaging process in the animal pupil detection mode of FIG. 12 startswhen the power is turned on by the power button being operated, forexample. An animal pupil detection mode is set in advance as a detectionmode for each specific part of the subject from a setting screen or thelike. FIG. 12 illustrates an exemplary case where the animal detectionunit 212-2 that detects a pupil of a cat or a dog detects a pupil of ananimal.

In step S111 of FIG. 12 , the system controller 131 determines whetheror not to terminate the process, for example, whether or not the powerbutton has been operated.

In a case where the process is determined to be terminated in step S111,the imaging process is terminated.

In a case where the process is determined not to be terminated in stepS111, the process proceeds to step S112.

In step S112, the imaging element 103 photoelectrically converts thelight from the subject collected through the lens 101 and the diaphragm102 in pixel units to obtain an electric signal of each pixel of theimage. An image signal, which is an electric signal of each pixel of theimage, is output to the memory 211 of the digital signal processing unit106 via the analog signal processing unit 104 and the A/D converter 105.

In step S113, the display control unit 214 causes the display unit 141to display an image based on the image data stored in the memory 211 asa live view image.

In step S114, the animal detection unit 212-2 detects a pupil area fromthe image data stored in the memory 211. The animal detection unit 212-2supplies information associated with the detected pupil area to the areasetting unit 213 and the display control unit 214.

In step S115, the display control unit 214 performs processing ofselecting the pupil area detected by the animal detection unit 212-2.According to the processing of selecting the pupil area, a pupil area inwhich a preliminary-notice frame is displayed is selected from aplurality of the detected pupil areas.

In step S116, the system controller 131 determines whether or not theuser has pressed the pupil AF button.

In a case where the pupil AF button is determined to have been pressedin step S116, the process proceeds to step S117.

In step S117, the system controller 131 forcibly changes the focus frameto a wide range.

In step S118, the animal detection unit 212-2 detects a pupil areawithin the focus frame changed to the wide range under the control ofthe system controller 131. Information associated with the detectedpupil area is output to the area setting unit 213 and the displaycontrol unit 214.

In step S119, the area setting unit 213 determines whether or not thepupil area has been detected. In a case where the pupil area isdetermined to have been detected in step S119, the process proceeds tostep S120.

In step S120, the area setting unit 213 sets the pupil area detected bythe animal detection unit 212-2 as a focus area. Information associatedwith the set focus area is supplied to the system controller 131.

Meanwhile, in a case where the pupil AF button is determined not to havebeen pressed in step S116, the process proceeds to step S121.

In step S121, the system controller 131 determines whether or not theuser has pressed the shutter button halfway or whether or not the userhas pressed the AF-ON button.

In a case where it is determined in step S121 that the shutter buttonhas been pressed halfway or the AF-ON button has been pressed, theprocess proceeds to step S122.

In step S122, the system controller 131 does not change the focus frame.

In step S123, the animal detection unit 212-2 detects a pupil areawithin the focus frame under the control of the system controller 131.Information associated with the detected pupil area is output to thearea setting unit 213 and the display control unit 214.

In step S124, the area setting unit 213 determines whether or not thepupil area has been detected. In a case where the pupil area isdetermined to have been detected in step S124, the process proceeds tostep S125.

In step S125, the area setting unit 213 sets the pupil area detected bythe animal detection unit 212-2 as a focus area. Information associatedwith the set focus area is supplied to the system controller 131.

In a case where the pupil area is determined not to have been detectedin step S125, the process proceeds to step S126.

In step S126, the area setting unit 213 sets the focus frame as a focusarea as another condition. Information associated with the set focusarea is output to the system controller 131.

Furthermore, in a case where it is determined in step S121 that theshutter button has not been pressed halfway or the AF-ON button has notbeen pressed, the process proceeds to step S127.

In step S127, the area setting unit 213 determines whether or not thepupil area has been detected. In a case where the pupil area isdetermined to have been detected in step S127, the process proceeds tostep S128.

In step S128, the area setting unit 213 sets the pupil area detected bythe animal detection unit 212-2 as a focus area. Information associatedwith the set focus area is supplied to the system controller 131.

In step S129, the display control unit 214 generates a pupilpreliminary-notice frame in the pupil area detected by the animaldetection unit 212-2, superimposes the pupil preliminary-notice frame onthe live view image, and causes the display unit 141 to display it.

Subsequent to steps S120 and S125, the process proceeds to step S130 ofFIG. 13 .

In step S130, the system controller 131 controls the lens driver 121 todrive the optical system such as the lens 101 and the diaphragm 102 insuch a manner that the focus area is in focus. Thereafter, the processproceeds to step S131.

The process also proceeds to step S131 subsequent to step S126 of FIG.12 .

In step S131, the system controller 131 determines whether or not thefocusing has been complete.

In a case where the focusing is determined to have been complete in stepS131, the process proceeds to step S132.

In step S132, the display control unit 214 causes the display unit 141to display an image based on the image data stored in the memory 211 asa live view image. Furthermore, the display control unit 214superimposes an in-focus frame (pupil frame or focus frame), which is aframe surrounding the set focus area, on the live view image, and causesthe display unit 141 to display it.

In a case where the focusing is determined not to have been complete instep S131, the process skips step S132 and proceeds to step S133.

Furthermore, in a case where the pupil area is determined not to havebeen detected in step S119 or S127 of FIG. 12 , the focusing is notperformed, and the process proceeds to step S133 of FIG. 13 . Theprocess also proceeds to step S133 subsequent to step S129.

In step S133, the system controller 131 determines whether or not theshutter button has been fully pressed on the basis of the signalscorresponding to the operation input from the operation unit 146. In acase where the shutter button is determined to have been fully pressedin step S133, the process proceeds to step S134.

In step S134, the imaging element 103 photoelectrically converts thelight from the subject collected through the optical system such as thelens 101 and the diaphragm 102 in pixel units to obtain an electricsignal of each pixel of the image. An image signal, which is an electricsignal of each pixel of the image, is output to the memory 211 of thedigital signal processing unit 106 via the analog signal processing unit104 and the A/D converter 105.

In step S135, the display control unit 214 causes the display unit 141to display an image based on the image data stored in the memory 211 asa captured image.

In step S136, the codec processing unit 215 encodes the image datastored in the memory 211. The codec processing unit 215 supplies theencoded image data to the storage 142.

In step S137, the codec processing unit 215 causes the storage 142 torecord the encoded image data. Thereafter, the process returns to stepS111, and the subsequent processing is repeated.

Furthermore, also in a case where the shutter button is determined notto have been fully pressed in step S133, the process returns to stepS111, and the subsequent processing is repeated.

Note that, in the process described above, descriptions have been givensuch that the focusing processing is not executed or the focusingprocessing is executed under other conditions such as the focus frame ina case where the pupil area has not been detected. The operation in acase where the pupil area has not been detected may be performedproperly according to the setting made by the user or the like. At thattime, the operation in the case of not having been detected may bechanged depending on the target subject or specific part that has notbeen detected.

For example, by performing the setting such that the focusing processingis not carried out in the case of not having been detected, it becomespossible to suppress further deterioration of the focusing precision ina case where motion of the target subject or specific part is small. Onthe other hand, by performing the setting such that the focusingprocessing is carried out at the position instructed by the user in thecase of not having been detected, it becomes possible to performpreliminary focusing processing in a case where motion of the targetsubject or specific part is large.

FIG. 14 is a flowchart illustrating the pupil area selection process instep S114 of FIG. 12 .

In step S151, the display control unit 214 determines whether or notthere are two or more pupil areas in the focus frame. For example, in acase where two animals are present at a position on the near side of theimaging device 100, pupils of the number of any of one to four may bedetected.

In a case where it is determined in step S151 that there are two or morepupil areas in the focus frame, the process proceeds to step S52.

In step S152, the display control unit 214 determines whether or notthere are two or more front pupil areas.

In a case where it is determined in step S152 that there are two or morefront pupil areas, the process proceeds to step S153.

In step S153, the display control unit 214 calculates a distance betweeneach pupil area and the center of the focus frame.

In step S154, the display control unit 214 selects the pupil area havingthe shortest distance from the center of the focus frame.

On the other hand, in a case where it is determined in step S151 thatthere are not two or more detected pupil areas in the focus frame, theprocess proceeds to step S155.

In step S155, the display control unit 214 selects one pupil area.

Furthermore, in a case where it is determined in step S152 that thereare not two or more front pupil areas, the process proceeds to stepS156.

In step S156, the display control unit 214 selects the front pupil area.

Subsequent to steps S154 to S156, the pupil area selection process isterminated, and the process returns to step S114 of FIG. 12 .

As described above, according to the present technology, apreliminary-notice frame that gives notice of a specific area to befocused is displayed on the image obtained by the imaging unit accordingto a type of the subject.

For example, in a case where the preliminary-notice frame is notdisplayed, the user performs an operation for instructing a start offocusing to carry out automatic focusing and imaging, which may lead toa result unintended by the user depending on conditions of the subject.

According to the present technology, with the preliminary-notice framedisplayed, it is known in advance that the intended position or anunintended position has been detected, whereby the user is enabled toselect not performing automatic focusing.

As described above, the user can easily focus on a specific part such asa pupil area or an animal itself according to the animal that is a typeof the subject.

Note that, while the process of detecting a pupil of an animal, such asa dog and cat, has been described in the descriptions above, the presenttechnology can be applied to a specific part of a subject, such as apupil, face, part of a face, neck, and head of all forms of life, suchas birds, fish, reptiles, and amphibians, or the entire body (subject).Furthermore, the present technology can also be applied to combinationsof those specific parts of the subject or the subjects.

Moreover, the present technology can be applied not only to a livingbeing but also to a specific part of a subject such as a headlight,front emblem, front window, or driver seat of a vehicle, or a headlightor helmet of a motorcycle.

In those cases, a detection mode for detecting a specific part of thesubject is preset and used. With this arrangement, it becomes possibleto give, to the imaging device, the user's intention such as whichdetection result or detection method is prioritized among a plurality ofdetection results or detection methods, or which subject is prioritizedamong a plurality of subjects.

Note that, unlike the case of a person, in the case of an animal havinglong hair, hair on a pupil may be focused instead of the pupil in anattempt to focus on the pupil. In this case, the position of the focalpoint is adjusted to the rear, or the imaging device is set in advancethat the subject is likely to be in focus on the hair and the imagingdevice performs control on the basis of the setting, whereby an imagingresult more suitable for the user's intention can be obtained.

However, even in the case of a subject having short hair, performing thesame control may result in an out-of-focus state. Therefore, it becomespossible to further improve the convenience by adjusting what type ofadjustment is to be reflected using a subject or specific part to bedetected and other detection results.

Note that, while a pupil of a person and a pupil of an animal aredetected by different detection processes in the descriptions above, apupil of a person may also be detected by the detection process same asa pupil of an animal.

Furthermore, the series of processing described above can be executed byhardware or by software. In a case where the series of processingdescribed above is executed by software, a program constituting thesoftware is installed from a network or a recording medium.

As illustrated in FIG. 5 , for example, the recording medium includesthe removable recording medium 148 on which the program is recorded,which is distributed to deliver the program to the user separately fromthe device main body. The removable recording medium 148 includes amagnetic disk (including a flexible disk) and an optical disk (includinga CD-ROM and a DVD). Moreover, a magneto-optical disc (including a minidisc (MD)), a semiconductor memory, and the like are also included.

In this case, the program may be installed in the storage 142 by theremovable recording medium 148 mounted in the drive 147.

Furthermore, the program may also be provided through a wired orwireless transmission medium such as a local area network, the Internet,and digital satellite broadcasting. In this case, the program may bereceived via the communication unit 145, and may be installed in thestorage 142.

In addition, the program may be installed in advance in the storage 142,a read only memory (ROM) in the system controller 131, or the like.

Note that the program to be executed by the computer may be a program inwhich processing is executed in a time-series manner according to theorder described in the present specification, or may be a program inwhich processing is executed in parallel or at a necessary timing suchas a calling is performed.

Note that, in the present specification, a system indicates a set of aplurality of constituent elements (devices, modules (parts), etc.), andit does not matter whether or not all the constituent elements are inthe same housing. Therefore, a plurality of devices housed in separatehousings and connected through a network, and one device in which aplurality of modules is housed in one housing are both systems.

An embodiment of the present technology is not limited to the embodimentdescribed above, and various modifications can be made without departingfrom the gist of the present technology.

For example, the present technology may employ a configuration of cloudcomputing in which one function is shared and jointly processed by aplurality of devices via a network.

Furthermore, each step described in the flowcharts described above maybe executed by one device or shared by a plurality of devices.

Moreover, in a case where a plurality of processes is included in onestep, the plurality of processes included in the one step may beexecuted by one device or shared by a plurality of devices.

Note that the effects described herein are merely examples and notlimited, and additional effects may be included.

<Exemplary Configuration Combination>

The present technology may also employ the following configurations.

(1) An imaging device including a display control unit that causes apreliminary-notice frame that gives notice of a specific area to befocused to be displayed on an image obtained by an imaging unitaccording to a type of a subject.

(2) The imaging device according to (1) described above, in which

the subject includes a person or an animal.

(3) The imaging device according to (1) described above, in which

the subject can be preset.

(4) The imaging device according to any one of (1) to (3) describedabove, in which

the specific area includes an area of a specific part of the subject.

(5) The imaging device according to (4) described above, in which

the specific part includes a pupil.

(6) The imaging device according to (1) described above, in which

the specific area includes an area of the subject.

(7) The imaging device according to any one of (1) to (6) describedabove, further including:

an area detection unit that detects the specific area, in which

in a case where a plurality of the specific areas has been detected, thedisplay control unit controls display of the preliminary-notice frameaccording to a focus setting frame for setting a focus area.

(8) The imaging device according to (7) described above, in which

the display control unit controls the display of the preliminary-noticeframe according to the specific area closer to a center position of thefocus setting frame.

(9) The imaging device according to (7) or (8) described above, furtherincluding:

a focus instruction unit that provides an instruction for startingfocusing in a unit of capturing of the image; and

an area setting unit that sets the detected specific area as a focusarea of the image in a case where the instruction for starting focusingis provided.

(10) The imaging device according to (9) described above, in which

the area setting unit sets the specific area detected within apredetermined range as the focus area.

(11) The imaging device according to (9) described above, in which

the area setting unit sets the specific area detected within apredetermined range indicated by the focus setting frame as the focusarea.

(12) The imaging device according to any one of (9) to (11) describedabove, in which

in a case where the area setting unit sets the focus area, the displaycontrol unit controls display of a focus area frame indicating the focusarea in place of the display of the preliminary-notice frame.

(13) The imaging device according to (9) described above, in which

the display control unit controls the display of the focus area frameusing a display method different from the display of thepreliminary-notice frame.

(14) The imaging device according (9) described above, in which the areasetting unit sets the specific area detected within a predeterminedrange indicated by the focus setting frame as the focus area.

(15) The imaging device according to any one of (6) to (10) describedabove, further including:

an imaging instruction unit that provides an instruction for imaging;and

a focus control unit that controls the imaging unit to perform thefocusing in the focus area set by the area setting unit to obtain theimage in a case where the imaging is instructed.

(16) An imaging method including:

causing, by an imaging device, a preliminary-notice frame that givesnotice of a specific area to be focused to be displayed on an imageobtained by an imaging unit according to a type of a subject.

(16) A program causing a computer to function as:

a display control unit that causes a preliminary-notice frame that givesnotice of a specific area to be focused to be displayed on an imageobtained by an imaging unit according to a type of a subject.

REFERENCE SIGNS LIST

-   -   100 Imaging device    -   101 Lens    -   102 Diaphragm    -   103 Imaging element    -   104 Analog signal processing unit    -   105 A/D converter    -   106 Digital signal processing unit    -   121 Lens driver    -   131 System controller    -   141 Display unit    -   142 Storage    -   146 Operation unit    -   211 Memory    -   212 Subject detection unit    -   212-1 Person detection unit    -   212-2 Animal detection unit    -   212-3 Animal detection unit    -   213 Area setting unit    -   214 Display control unit    -   215 Codec processing unit

1. (canceled)
 2. An imaging apparatus, comprising: an imager configuredto acquire an image; and circuitry configured to: set a face area of ahuman as a first type of in-focus area of the image, set a pupil area ofthe human as a second type of in-focus area of the image, and set apupil area of a cat or dog as a third type of in-focus area of theimage.
 3. The imaging apparatus according to claim 2, wherein thecircuitry is further configured to omit setting a face area of the cator dog as an additional in-focus area of the image.
 4. The imagingapparatus according to claim 2, wherein the circuitry is furtherconfigured to control a display unit to display a notice frame thatgives notice of a specific area to be focused on the image.
 5. Theimaging apparatus according to claim 4, wherein the notice framesurrounds the face area of the human, the pupil area of the human or thepupil area of the cat or dog based on a setting.
 6. The imagingapparatus according to claim 2, wherein the circuitry is furtherconfigured to set the pupil area of the cat or dog as a selectedin-focus area of the image based on receiving indication of a pressingof a physical button.
 7. The imaging apparatus according to claim 6,wherein the physical button is an autofocus button.
 8. The imagingapparatus according to claim 6, wherein the physical button is adedicated button for instructing a start of pupil focusing.
 9. Anon-transitory computer readable medium storing program code, theprogram being executable to perform operations comprising: receiving animage captured by an imager; setting a face area of a human as a firsttype of in-focus area of the image; setting a pupil area of the human asa second type of in-focus area of the image; and setting a pupil area ofa cat or dog as a third type of in-focus area of the image.
 10. Thenon-transitory computer readable medium according to claim 9, whereinthe operations further comprise: omitting a setting of a face area ofthe cat or dog as an additional in-focus area of the image.
 11. Thenon-transitory computer readable medium according to claim 9, whereinthe operations further comprise: controlling a display unit to display anotice frame that gives notice of a specific area to be focused on theimage.
 12. The non-transitory computer readable medium according toclaim 11, wherein the notice frame surrounds the face area of the human,the pupil area of the human or the pupil area of the cat or dog based ona setting.
 13. The non-transitory computer readable medium according toclaim 9, wherein the operations further comprise: setting the pupil areaof the cat or dog as a selected in-focus area of the image based onreceiving indication of a pressing of a physical button.
 14. Thenon-transitory computer readable medium according to claim 13, whereinthe physical button is an autofocus button.
 15. The non-transitorycomputer readable medium according to claim 13, wherein the physicalbutton is a dedicated button for instructing a start of pupil focusing.16. A method comprising: receiving an image captured by an imager;setting a face area of a human as a first type of in-focus area of theimage; setting a pupil area of the human as a second type of in-focusarea of the image; and setting a pupil area of a cat or dog as a thirdtype of in-focus area of the image.
 17. The method according to claim16, further comprising: omitting a setting of a face area of the cat ordog as an additional in-focus area of the image.
 18. The methodaccording to claim 16, further comprising: controlling a display unit todisplay a notice frame that gives notice of a specific area to befocused on the image.
 19. The method according to claim 18, wherein thenotice frame surrounds the face area of the human, the pupil area of thehuman or the pupil area of the cat or dog based on a setting.
 20. Themethod according to claim 16, further comprising: setting the pupil areaof the cat or dog as a selected in-focus area of the image based onreceiving indication of a pressing of a physical button.
 21. The methodaccording to claim 20, wherein the physical button is an autofocusbutton.
 22. The method according to claim 20, wherein the physicalbutton is a dedicated button for instructing a start of pupil focusing.